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The data processing inequality (DPI) is a fundamental feature of information theory. Informally 
it states that you cannot increase the information content of a quantum system by acting on it 
with a local physical operation. When the smooth min-entropy is used as the relevant information 
measure, then the DPI follows immediately from the definition of the entropy. The DPI for the von 
Neumann entropy is then obtained by specializing the DPI for the smooth min-entropy by using 
the quantum asymptotic equipartition property (QAEP). We provide a new, simplified proof of the 
QAEP and therefore obtain a self-contained proof of the DPI for the von Neumann entropy. 



1. INTRODUCTION 

The data processing inequality (DPI) has an intu- 
itive interpretation: the information content contained 
in a quantum system cannot increase by performing local 
data processing on that system. It is an extremely useful 
property that is used extensively in quantum informa- 
tion [l|. The DPI has been known to hold for different 
entropy measures, including an important quantity: the 
von Neumann entropy 0). The DPI is typically stated 
for the case where the local operation is a partial trace, 
but this can be generalized to any physical operational 
Formally it is 



H{A\BC) P < H(A\B) 



/>■ 



(1) 



where the conditional von Neumann entropy H(A\B) 
is the uncertainty about the system A given the sys- 
tem B. It is denned on a normalized state in the 
Hilbert space Hab, Pab € S=(Hab), as H{A\B) p := 
H(AB)p-H(B) p , where H{A) P := -Tr(plogp) (all log- 
arithms are taken to the base 2). Also, Eqn. [T]is equiv- 
alent to the strong subadditivity of the von Neumann 
entropy: H{ABC) p + H{B) p < H{AB) p + H(BC) p . 

The first proofs of this property relied on abstract op- 
erator properties (S-Q- Recently, these proofs have been 
simplified [6-8]. Other approaches have used the oper- 
ational meaning of the von Neumann entropy [9j, llOj . 
Minkowski inequalities [IJ, LL2| . or holographic gravity 
theory [13], |l4J . There has also been recent interest in 
the structure of states where there is equality in the DPI 
[l5l - tr7l ] . Our approach provides a new perspective by de- 
composing the proof of the DPI into a simple proof of a 
more fundamental property, followed by a specialization. 
It also provides a new approach to teaching the DPI. 

In this paper we first prove the DPI for a different 
entropy: the smooth min-entropy (Theorem [1]). This in- 
equality follows directly from the partial trace applied to 



the definition of the smooth min-entropy [181 ] . Then we 
can specialize the smooth min-entropy to the von Neu- 
mann entropy by the quantum asymptotic equipartition 
property (QAEP) (Theorem [2J [191 . H owever, here we 
provide a simpler proof to that of [19( so that we have 
a self-contained proof for the von Neumann entropy DPI 
(Theorem EJ. 



SMOOTH MIN-ENTROPY 



It has become apparent in recent works [18H21J that 
smooth min-entropy is a relevant quantity for measuring 
quantum information. It is defined a.ao 

H^ in (A\B) p := max{A e B | 3 p' AB e B e (j> AB ), 

o B G S = {H B ) s.t. p' AB < 2- A l A <g> <Jb}- (2) 

The state o~b is chosen from the set of normalized 
states S=(Hb) m the Hilbert space ris- The state p' AB 
is chosen from the set of sub-normalized states in the 
Hilbert space Hab, that are also close to the state pab- 

B\pab) := {p'ab\Pab^ s <{'H-ab)-,P{pab-,Pab)< (: }- 
To specify this e-ball around a state p, we use the puri- 
fied distance P(p, <r) := ^/l — F(p,a) 2 (where F(p, cr) := 



3. DATA PROCESSING INEQUALITY 

If the entropies are interpreted operationally then The- 
orem [T] deals with data processing in the one-shot sce- 
nario: a local physical operation is performed on a tri- 
partite quantum system once, and a statement is made 
about the information content of such a system. Theo- 
rem [3] can be interpreted as an average scenario: a state- 
ment is made about the information content on average 



1 The Stinespring dilation allows for any completely positive trace 
preserving (CPTP) map to be decomposed into a unitary fol- 
lowed by a partial trace. Since the von Neumann entropy is 
invariant under unitaries, the DPI applies to any CPTP map 
applied to the system BC. 



It is sufficient to take the maximum over A if a finite dimen- 
sional system is considered. However, in infinite dimensions it is 
necessary to take the supremum |22l| . 
3 If p and a are not normalized, then the generalized fidelity is 
used: F{p,a) := ll-^/p® (1 - Trp)^cr ® (1 - Trcr) II . 



after applying a local physical operation to a tri-partite 
quantum state. 



A. General Data Processing Inequality 

Theorem 1 (Smooth min-entropy DPI). 
Let p £ S = (Habc), then 



Kun(A\BC) p < H* min (A\B] 



/>■ 



(3) 



Proof. First, we let A := H^ in (A\BC) p , and we choose 
the particular pabc S B e (PABc) an d cfb hi the definition 
of H^ in (A\BC) p such that A is maximized. From Eqn. [5] 
we have pabc < '2~ x ^a®&bc, and by tracing out system 
C we get: pab < 2 1a <8> cb- We know that pabc & 
B e {PABc), and therefore P(pabcPabc) < £■ Since 
the purified distance does not increase under the partial 
trace (see Lemma |B~TJ) . it follows that P(pab,Pab) < £• 
Therefore we have pab £ B e (pAB), and ob £ S=(Hb), 
which are candidates for maximizing _ff^ lin (yl|i?)p. □ 



B. Specialized Data Processing Inequality 

Now we have completed the proof of the DPI in the 
most general case, and the only remaining difficulty is to 
specialize Theorem Q] to the DPI for the von Neumann 
entropy This specialization is achieved by using the limit 
of many i.i.d. copies of a state, called the QAEP (19| . 

Theorem 2 (QAEP). 

Let p £ S=(Hab) then 

lim lim -H^ in (A n \B n ) p ^ = H(A\B) p . (4) 

This directly reduces Theorem [T] to the DPI for the 
von Neumann entropy. 

Theorem 3 (von Neumann entropy DPI). 
Let p £ S = (Wabc) , then 



H(A\BC) P < H(A\B) p . 



(5) 



However, in order to have a self contained proof of the 
data processing inequality for the von Neumann entropy 
we provide an alternative, shorter proof of the QAEP 
than that of 111. 



QUANTUM ASYMPTOTIC EQUIPARTITION 
PROPERTY 



be obtained by bounding the smooth min entropy by the 
von Neumann entropy of a different state, and then us- 
ing the continuity of the von Neumann entropy when the 
i.i.d. limit is taken fLemma lA.ll) . 

For these proofs we will need the smooth th or- 
der Renyi entropy, which is defined as Hq(A) p := 
mm p'GB € (p) Ha{A) p i, where Hq(A) p :— logrankp. In ad- 
dition, we will need the non-conditional smooth min- 
entropy defined as H^ in (A) p := max p . eB .( p ) H min (A) p >, 
where H m i n (A) p := — log HpH^- The infinity norm is de- 
fined as ||p H,^ := maxi{|Ai|}, where A^ are the eigenvalues 
of p. 

Lemma 4.1 (Lower bound on the conditional smooth 
min-entropy). Let pab £ S=(Hab) then, 



H{A\B) p < lim lim -H f min (A n \B n ) p 



e— J-0 n— >-oo n 



(6) 



Proof. First we use the chain rule Lemma 15.11 applied to 
the state p £ S = (Hab)'- 



Hl, n {AB) P - HUB) P < H^(A\B) f 



(7) 



We can apply Eqn. [7] to the state p® n , divide by n, and 
then take the limit as e — > and n — > oo. Using the 
non-conditional QAEP of Lemmas 15.21 and 15.31 we get 

H(A\B) P 

< lim lim -(Hl in (A n B n ) p ^ - -H^B")^), (8) 

where we use the definition of the conditional von Neu- 
mann entropy. □ 

Lemma 4.2 (Upper bound on the conditional smooth 
min-entropy). Let pab £ S—{^H) then, 



1 



lim lim -H^ in (A\B) p < H(A\B). 



(9) 



e— >0 n— )-oo ft 

Proof. First, we use Lemma I5U1 for the state p^ Bn '- 

H< min (A n \B n ) p ® n < H(A"\B n ) p , (10) 

where p £ B i (p A y ^). Dividing by n, then taking the limit 
as e — > and n — > oo, and using Lemma I A. II we have: 



lim lim -H(A n \B n )p = H(A\B) p . (11) 

c— >0n- >oo n 



□ 



In order to prove Theorem [2] we upper and lower 
bound lim e ^ lim„^ OCJ ff r £ nin (A"|B") p «„ by H{A\B) p . 
The lower bound (Lemma 14.11) is obtained by ap- 
plying a chain rule to the conditional smooth min- 
entropy such that it is bounded by a difference of non- 
conditional smooth entropies. The i.i.d. limit of non- 
conditional smooth entropies can then be taken (Lem- 
mas 15.21 and I5.3[) . The upper bound fLemma 14. 2\ can 



5. PROPERTIES OF SMOOTH ENTROPIES 

The following are properties of smooth entropies used 
to prove Lemmas 14.11 and 14.21 In particular, we bound 
the smooth min-entropy and smooth O^-order Renyi en- 
tropy in order to perform the i.i.d. limit of e — > 0, n — > oo. 
For additional properties used in the following proofs, see 
the appendices. 



Lemma 5.1 (Chain rule). Let p G S = (Hab)- Then 

H^(AB) p - H* (B) P < HlUA\B) p . (12) 

Proof. First, we pick the particular p' AB G B e (pAB) hi 
the definition of the non-conditional smooth min-entropy 
H^ in (AB) p = A such that it is maximized. We also pick 
the particular ps G B e (ps) from the definition of the th 
order Renyi entropy such that it is minimized, and write 
the projector onto its support as II := n supp (p B ). Now 
given that p' AB < 2~ x 1ab, then IIp^ B II < 2" a 1a ® 
lsupp(p B ), so we have 

H^ in (AB) p = {A|n P ^ B n < 2-H A ® t supp( p B) } . (13) 

Now we will need to ensure that pab '■= Hp' AB II is close 
to pab- To do this, we use the triangle inequality for 
the purified distance (see Lemma 5 of [23|]) in the first 
and third lines, as well as the fact that the purified dis- 
tance decreases under the CP trace non-increasing map 
p — > HpH (Lemma IB.1[) in the second line: 

P{pab,Pab) < P{pab,Pab) + P{pab,Pab) (14) 

<P(Pab>Pab)+P(pab,Pab) (15) 

<P{Pab,Pab) + 2P{pab,Pab) (16) 

= 6 + 2P(pab,Pab), (17) 

where we purify ps to the state \<j>)abc and define 
Pab ■■= Tr c (|0)(0|) (see Lemma 8 of [23[). Now all that 
is left to find is P(p~ab, Pab)- From Theorem|4]we have: 



P(\4>)abcM)abc) =P(pb,Pb), 



(18) 



where \4>)abc is chosen to be a purification of ps such 
that Trc\ip)(i^\ = pab- Now since the purified distance 
doesn't increase under the partial trace (see Lemma IB. II) : 



P(\<f>) A BC, \i>)ABc) < P{pab,Pab) < P(PB: Pb)- (19) 
Combining Eqns. [TH] [19] we get 

P{\4>)abc, \i>)ABc) = P{pab,Pab) = P(pb, Pb)- (20) 

We know that P(pb,Pb) < e , and therefore 
P{Pab,Pab) < e- This makes Eqn. [T7| P{pab, Pab) < 
3e. Now returning to the the smooth min-entropy in 
Eqn. [T3l we define t Pb := l SU p P (p B )/rank(pB) so that we 
have 



Proof. First, we calculate the quantum Renyi entropy of 
order a, defined as H a (A) p := 1/(1 — a) logTrp Q for the 

state p® n : 



H a (A n ), 



nH a {A) f 



Now we may write Eqn. [25] from Lemma 15.41 as 
lim lim -H e min (A n ) p9n > H a (A) p . 



(23) 



(24) 



This is true for all a > 1 and so in particular, it's true 
if we take the limit as a — > 1 + , where we know from 



Lemma IA~2l that lim Q _>i H a (A) p = H{A), 



U 



Lemma 5.3 (Non-conditional QAEP for O^-order Renyi 
entropy). Let p £ S = (H) then, 



1 



H{A) p > lim lim -H$(A n ) 



e— »0 n—too fi 



(25) 



Proof. This follows in a similar manner to the proof of 
Lemma l5.2i but now Lemma 15.51 is used. □ 



Lemma 5.4 (Lower bound on the smooth min-entropy). 
Let p G S—{Ji), and a > 1, e G [0, 1] then 



H a (A) p 



log(l - ^/T^e I ) 



1 



< ffmin(A 



(26) 



Proof. First, we let p = Yl x ^\ x )( x \- We construct a 
quantum state a whose eigenvectors are the same as p, 
and whose eigenvalues, v x , are v x = \ x if x £ X and 
v x = otherwise, where X := {x G {1, 2, . . . , dimH} : 
\ x < A*}, and A* G [0,1]. Hence a G S<(H). Now we 
may write the fidelity between p and a as 



IvW^ii! = ^2 x l 



We can write (for a > 1) 



/ 2 ,/V2 _ 



$> 



x£X 



|(«-1) 



y: x x 



^A^^Ar^^Hcr 

x X £X x^X 

= \\o-\t- 1) (l-F(p,a)). 



(27) 



(28) 



(29) 



By taking the log of this equation and since v x < \\o~\ 
Vx we get 

1 



H^ in (AB) p = { A + rank( j 5 s ) | Up' AB U < 2" A 1 A <g> r PB } ff«(^) P < j— - tog(l - F(p, a)) + H min {A) a . (30) 



< max min { A I p" AB < 2 x 1a <S> o\b} + log(rank(/5 B )) 

p"GB 3 '(p) <TB 



H^ n (A\B) 



PAl 



H&B) 



I'B ■ 



(21) 
□ 



1-a 

Now we choose a particular A* so that the fidelity is 

fixed to be F(p,a) = y/Y~? (1 > e > 0). This 

means that P(p.a) < e, and hence a G B e (p), so 



H min (A) a < H^{A) f 



D 



Lemma 5.2 (Non-conditional QAEP for smooth min-en- 
tropy). Let p G S = (Ha) then, 



Lemma 5.5 (Upper bound on the th order Renyi en- 
tropy). Let p G S = (H), and 1/2 < a < 1 i/ien 



#(4), < lim lim -H^{A n ) 



n— »oc tt, 



(22) 



^0 £ (^)p < ffa^p 



1 



log VT 



(31) 



Proof. This proof follows similarly to the proof of 
Lemma 15.41 We can construct a quantum state a in 
the same manner as Lemma [5.41 Now 1/2 < a < 1 so 



we have £ a \« > £^ A« > (l/ranka)^ 1 ) £ x£A , V 
Taking the log gives H a (A) p > T ^\ogF(p,a) + H (A) IJ . 
Now we choose a particular A* so that we can write the fi- 
delity as F(p, a) = VI -e, (1 > e > 0), and so a G i3 e (/9). 
Then J?o(^4.)<7 > #o(^)p, which gives the result. □ 



Lemma 5.6 (Relation of conditional von Neumann en- 
tropy and conditional smooth min-entropy). Let p £ 
S = ("H), then 3 p e B e (p) such that 



H* min (A\B) p < H{A\B), 



(32) 



Proof. We start with the definition of the conditional 
von Neumann entropy for subnormalized states pab € 
S<{Hab), so we have 



H{A\B)p := — ^maxTr(^ B (log(l A 



(Tb) - log(pAB))) > 



Trp 



.■IB 



-Tr(pAs(log(AllA ® Ob) - log(pAs))) - log A, 



where we drop the maximization, picking a specific <r B : 
the state that allows A to be maximized in H lrL i n (A\B) p . 
We have also added and subtracted log A, defined as 
— log A = H^ nin (A\B) p , and we choose p to be the 
state that allows A to be maximized in the definition 
of H^ nin {A\B)p. Also, to simplify our expression, we 
use the quantum relative entropy, defined as H(p\\a) :— 



I 

Tr(plog p) — Tr(ploga). Now we may write 

-H(p AB \\\t A ®o- B )+Hf nin (A\B) p > H* min (A\B) f 



Trp 



AB 



where in the last line, we use the monotonicity of the log 
to show that pAB^ogpAB < PAB^og(XtA <8> Ob). This 
then implies —H(p~ab\\^a ® cr' B ) > 0. D 
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Lemma A.4 of [|j|, we know that P(p' n , o' n ) > P(p' n , a n ). 
The purified distance is lower bounded by the trace dis- 
tance, and so P(p' n ,a n ) > D(p' n ,a n ) (see [26|). Now 
since a nA G B e (p® n ) we know D{p' n ,cr n ) < e. Now we 
may use Fanne's Inequality [27j: 



lim lim - \H(A n ) 



H(A») f 



< lim lim -(elogcT + 77(e)) = 0, 



(A-2) 
(A-3) 



where we define 77(2;) := —x log x, and d — dim(H). This 
is not the limit we would like to know, so we compare the 
entropies here to those of Eqn. IA-11 for trivial B. From 
the definition of a n we know that H(A n )„ n — H(A n ) an — 
77(1 — Trer„) and so 



lim lim -\H(A n ) ®n-H(A n ) a J 

e— >0n->oo n 

< lim lim -(\H{A n ) p , -H{A n ) dr 

e— K) n— )-oo 77, n 

= 0, 



(A-4) 
|Tj(l-Thr„)|) 



where we know that < (1 — Tr o riA ) < 1, and hence 
< 77(1 -Trcr n J< 1/2. 

When B is non-trivial we can combine Eqn. IA-41 with 
Eqn. [23] and the definition of the conditional von Neu- 
mann entropy to get the result. □ 

Lemma A. 2 (Relation of Renyi entropy and von Neu- 
mann entropy). Let p G S—{H) then, 



lim H a (A) p = H(A) p . 

a— >1 



Proof. See [24 1 . 



(A-5) 
□ 



Appendix B: Known Distance Properties 



Appendix A: Known Entropic Properties 

The following are known properties used in the proof 
of Theorem [2] which we include here for completeness. 

Lemma A.l (Limit of the conditional von Neumann 
entropy of an almost i.i.d. state). Let p G S = ('H) and 
a n G B e (p® n ), then 



lim lim -H(A r 

e— >0 n— >oo xi 



\B n ) an - H(A\B) 



p- 



(A-l) 



Proof. First, we know that a n G B c (p® n ), and by Eqn. [20] 
we have P(p^ n ,a nB ) < e. Now we show Eqn. IA-11 is 
valid when the system B is trivial, i.e. H(A n \B n ) a = 
H(A n )„ n and H{A\B) p = H{A) p (see Chapter 3 of 0]). 
First, we extend pf 1 and <j nA to p' n := pf 1 © and 
a' n := <T nA Q)(l-Tra nA ) so that a' n G S = {H A ®'H 1 ) (where 
"Hi is a one dimensional space). Next, we define the state 
a,, := J^i s 'iV)(i\i where s[ are the eigenvalues of a' n or- 



dered such that s' > s' , , , Vi and 



in 



oip' n . It is clear that Pipf 1 , a riA ) 



are the eigenvectors 
P(p' n ,a' n ), and so by 



Theorem 4 (Uhlmann's Theorem). Given p,a G S = ('H) 
then 

F(p,a) = max l<</#)| = max |(^|0)|, (A-l) 

m,m \<t>) 

where \<p), \ip) are purifications of p and a respectively. 

Proof. See Theorem 9.4 in or [H]. □ 

Lemma B.l (Purified distance under CP trace non- in- 
creasing maps) . Let £ be a trace non-increasing map, and 
p,a G S<(H) then, 



P(£(p),£(a))<P(p,a). 



(A-2) 



This can be proven by using the fact that the fidelity 
cannot decrease under completely positive trace non- 
increasing maps. 



Proof. See Lemma 7 of [23 



□ 



